Beta-Divergence as a Subclass of Bregman Divergence
نویسندگان
چکیده
منابع مشابه
Penalized Bregman Divergence Estimation via Coordinate Descent
Variable selection via penalized estimation is appealing for dimension reduction. For penalized linear regression, Efron, et al. (2004) introduced the LARS algorithm. Recently, the coordinate descent (CD) algorithm was developed by Friedman, et al. (2007) for penalized linear regression and penalized logistic regression and was shown to gain computational superiority. This paper explores...
متن کاملBregman divergence as relative operator entropy
vet C e onvex set in fnh spe nd r e rilert speF por n opertorE vlued smooth funtionl © X C 3 B@rAD we dene the Bregman divergence of x; y P C s D © @x; yA Xa ©@xA ©@yA lim t3CH t I ©@y C t@x yAA ©@yA : ell tht originlly vev fregmn introdued this onept for relEvlued onvex funE tions © PF yn the selfEdjoint opertorsD there is stndrd prtil orderingD A...
متن کاملConvex Relaxations of Bregman Divergence Clustering
Although many convex relaxations of clustering have been proposed in the past decade, current formulations remain restricted to spherical Gaussian or discriminative models and are susceptible to imbalanced clusters. To address these shortcomings, we propose a new class of convex relaxations that can be flexibly applied to more general forms of Bregman divergence clustering. By basing these new ...
متن کاملBregman divergence as general framework to estimate unnormalized statistical models
We show that the Bregman divergence provides a rich framework to estimate unnormalized statistical models for continuous or discrete random variables, that is, models which do not integrate or sum to one, respectively. We prove that recent estimation methods such as noise-contrastive estimation, ratio matching, and score matching belong to the proposed framework, and explain their interconnecti...
متن کاملBig-data Feature Screening Using Bregman Divergence
Modern biomedical data usually are big: they have high dimensions and/or massive volumes as a result of fast advancement in sensing and information technologies. Many components of the data, however, may not play any important role for tasks of interest. Reducing the dimensionality of the data turns out to be critical for obtaining accurate result and a good generalization capability. This pape...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Signal Processing Letters
سال: 2011
ISSN: 1070-9908,1558-2361
DOI: 10.1109/lsp.2010.2096211